Spike-based cross-entropy method for reconstruction

نویسندگان

  • András Lörincz
  • Zsolt Palotai
  • Gábor Szirtes
چکیده

Most neural optimization algorithms use either gradient tuning methods or complicated recurrent dynamics that may lead to suboptimal solutions or require huge number of iterations. Here we propose a framework based on the cross-entropy method (CEM). CEM is an efficient global optimization technique, but it requires batch access to many samples. We transcribed CEM to an online form and demonstrated by computer simulations. We argue that this framework allows for neural implementation and suggests a novel computational role for spikes in real neuronal systems. & 2008 Elsevier B.V. All rights reserved.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Information through a Spiking Neuron

While it is generally agreed that neurons transmit information about their synaptic inputs through spike trains, the code by which this information is transmitted is not well understood. An upper bound on the information encoded is obtained by hypothesizing that the precise timing of each spike conveys information. Here we develop a general approach to quantifying the information carried by spi...

متن کامل

Competitive spiking and indirect entropy minimization of rate code: efficient search for hidden components.

Our motivation, which originates from the psychological and physiological evidences of component-based representations in the brain, is to find neural methods that can efficiently search for structures. Here, an architecture made of coupled parallel working reconstruction subnetworks is presented. Each subnetwork utilizes non-negativity constraint on the generative weights and on the internal r...

متن کامل

Biological Neural Network Structure and Spike Activity Prediction Based on Multi-Neuron Spike Train Data

The micro-scale neural network structure for the brain is essential for the investigation on the brain and mind. Most of the previous studies typically acquire the neural network structure through brain slicing and reconstruction via nanoscale imaging. Nevertheless, this method still cannot scale well and observation on the neural activities based on the reconstructed neural network is not poss...

متن کامل

Bitmap reconstruction for document image compression

We introduce a pattern matching algorithm and a bitmap reconstruction method used in document image compression. This pattern matching algorithm uses the cross entropy between two patterns as the criterion for a match. We use a physical model which is based on the nite resolution of the scanner (spatial sampling error) to estimate the probability values used in cross entropy calculation. The ma...

متن کامل

Trial-Shuffle Method for Inferring Information Transfer in Spike-train Data Sets

Understanding information processing in the brain requires the ability to determine the functional connectivity between the different regions of the brain. We present a method using transfer entropy to extract this flow of information between brain regions from spike-train data commonly taken in neurological experiments. Transfer entropy is a statistical measure based in information theory that...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Neurocomputing

دوره 71  شماره 

صفحات  -

تاریخ انتشار 2008